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Currently  photo  interpretation  and  terrain  image  identifica¬ 
tion  for  military  applications  is  performed  manually.  This  work  is 
time  consuming  and  costly.  The  work  described  below  is  a  first  step 
to  aiding  or  semi-automating  some  of  these  labor  intensive  tasks. 


A  semi-automated  technique  for  extracting  a  selected  set  of 
cartographic  features  such  as,  road  intersections,  straight  line 
roads,  and  rectangular  objects  from  aerial  photographs  was  recently 
developed  at  the  U.S.  Army  Engineer  Topographic  Laboratories  (USAETL) 
using  the  Walsh  transform.  The  discrete  function  (Walsh)  transform 
was  chosen  because  of  its  simplicity  (Walsh  functions  are  only  two- 
valved)  resulting  in  simple  implementation,  and  because  Walsh  func¬ 
tions  conform  to  the  selected  set  of  the  cartographic  features.  Since 
the  Walsh  transform  coefficients  were  produced  by  using  Walsh  func¬ 
tions  having  alternate  magnitudes  (either  +1  or  -1)  at  different  se¬ 
quences,  the  Walsh  transform  coefficients  are  also  decomposed  spectral 
components  of  the  signal  signature  of  the  input  aerial  photographic 
images.  ^ 


^ — - —  The  technique  was  investigated  in  two  ways  as  follows: 

(1)  Using  a  32- by  32-element  solid  state  sensor  array  to  convert  ^ 
aerial  imagery  into  an  electronic  signal  which  was  processed  in  a 
minicomputer  to  yield  Walsh  transforms  of  the  image  £lj.  (2)  A  proto¬ 
type  image  spectrum  analyzer  (PISA)  was  developed  which  utilizes  a 
large  size  plasma  discharge  device  (8.5-by  8.5-inch  illuminating 
area  with  512  electrodes  each  in  both  x  and  y  directions)  to  generate 
two-dimensional  Walsh  function  patterns,  and  produce  512  by  512  Walsh 
coefficients  in  14  seconds  [2].  The  PISA  produced  successful  results 
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for  a  selected  set  of  targets  representing  man-made  cartographic 
features  of  the  type  stated  above.  The  sensor  array-minicomputer 
system  provides  a  variable  image  threshold  which  results  in  better 
control  of  the  input  images.  The  cartographic  features  as  described 

with  background  scenes  and  noise  were  extracted  successfully  from 
aerial  Imagery. 

The  sensor  array-minicomputer  system  described  in  [1]  was 
further  expanded  to  incorporate  a  classification  scheme  to  become  a 
semi-automated  cartographic  feature  extraction  and  recognition  system. 
This  paper  describes  this  experimental  system  which  was  Implemented 
with  a  solid  state  sensor  array  as  an  opto-electronic  converter,  a 
minicomputer  as  a  signal  processor  to  perform  the  functions  of  feature 
extraction  and  recognition,  and  a  computer -controlled  translational 
stage  as  the  imagery  holder.  Successful  extraction  and  recognition 
results  for  the  selected  set  of  cartographic  features  using  this 
experimental  system  are  presented.  An  alternate  method  for  detecting 
the  decomposed  signal  signatures  representing  cartographic  features 
using  analog  signal  processors  is  briefly  described,  and  conclusions 
are  given. 


SYSTEM  CONFIGURATION 

A  system  that  will  produce  signal  signatures  from  the  grey- 
shade  distribution  of  a  photo  transparency  in  a  short  time  and  with 
recognizable  resolution  was  developed.  The  block  diagram  of  such  a 
system  is  shown  in  Figure  1. 

A  9-  by  9-inch  aerial  transparency  is  illuminated  by  a  white 
light  source,  and  a  section  of  the  image  is  projected  on  a  Reticon 
32-  by  32-element  solid  state  array  with  a  lens.  The  array  converts 
the  optical  energy  of  the  image  into  a  video  signal.  The  array 
timing  and  video  signals,  after  being  conditioned  and  digitized  by 
the  computer  interface  are  sliced  by  the  Hewlett-Packard  (HP)  2100 
minicomputer  into  two  values,  ’’on"  and  "off."  The  threshold  value  of 
the  slicing  is  variable,  which  provides  a  very  convenient  means  for 
isolating  signals  representing  the  selected  feature  image  from  the 
unwanted  background  noise.  The  "on11  value  of  the  video  is  arbitrari¬ 
ly  set  to  "lOO"  and  "off"  to  #l0,,r  and  the  quantized  Image  is  printed 
by  a  line  printer  as  a  two-dimensional  binary  array  of  32  by  32  pixels 
that  represent  the  spatial  signal  signature  of  the  selected  topograph¬ 
ic  features.  The  sliced  signal  is  transformed  into  a  32  by  32  Walsh 
matrix  with  a  conventional  Walsh  transform  algorithm  in  the  computer. 
This  algorithm  implements  the  two-dimensional  discrete  Walsh  trans¬ 
form  [33, 
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Figure  1.  System  Block  Diagram 
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Figure  2.  First  8-  by  8-Order,  Two-Dimensional  Walsh  Functions 
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where  f(x,y)  is  the  image  binary  array,  Wal(i,x)  Wal(j,y)  is  the  two- 
dimensional  Walsh  function  of  order  i  and  j,  and  x,y,i,  and  j  take 
values  from  1  through  32.  By  sequentially  changing  the  order  of  the 
Walsh  function,  the  complete  set  (32  by  32)  of  the  Walsh  transform 
coefficients  was  obtained.  The  Walsh  functions  used  are  permanently 
stored  in  the  minicomputer.  Figure  2  shows  the  first  8  by  8  order, 
two-dimensional  Walsh  functions  in  the  x  and  y  ranges  of  -h  to  4^. 

The  black  areas  indicate  +1  in  magnitude,  and  white  -1. 


Since  the  Walsh  transform  coefficients  are  produced  by  using 
Walsh  functions  having  spatially  alternating  magnitudes  (from  +1  to 
-1)  at  different  sequences,  the  Walsh  transform  coefficients  represent 
the  decomposed  spectral  components  of  the  signal  signature  of  the  in¬ 
put  signal.  These  spectral  components  were  divided  by  a  convenient 
constant,  in  this  case  1,024,  which  is  the  number  of  pixels  in  a 
frame  for  normalization  purposes.  The  entire  normalized  set  of  the 
spectral  components  was  printed  out  by  the  line  printer. 


A  detection  scheme  was  implemented  based  on  the  uniqueness  of 
the  Walsh  transform  of  each  feature  under  consideration.  At  first  a 
reference  signal  signature  was  established  for  each  cartographic  fea¬ 
ture  of  the  entire  selected  set.  The  test  imagery  after  being  trans¬ 
formed  into  the  Walsh  domain  was  then  compared  to  each  reference  sig¬ 
nal  signature  sequentially,  and  classification  was  made.  Since  carto¬ 
graphic  features  may  appear  in  a  variety  of  locations  in  the  window 
of  inspection  (for  this  case,  the  active  surface  of  the  solid  state 
array) ,  and  because  Walsh  transforms  are  neither  translationally  nor 
rotationally  invariant,  two  or  more  reference  signal  signatures  are 
required  for  each  class  of  cartographic  feature  to  avoid  misclassifi- 
cation.  With  this  modification,  four  classes  out  of  the  entire  seven 
cartographic  feature  classes  selected  were  recognized  without  error 
regardless  of  their  location  with  respect  to  the  window.  The  rest  of 
the  features  were  also  classified  correctly  in  the  majority  of  loca¬ 
tions.  However,  mlsclassificatlon  occurred  when  these  feature 
classes  were  located  very  close  to  the  corners  of  the  window.  Both 
the  magnitude  of  a  single  Walsh  transform  coefficient  (or  the  sum  of  a 
row  or  column  of  the  transform  coefficients),  and  the  ratio  of  each 
significant  coefficient  to  A(l,l)  or  A(2,l)  or  A(3,l)  were  used  as 
reference  signal  signatures  for  classification.  At  the  end  of  each 
classification,  the  translational  stage  was  automatically  moved  a 
predetermined  number  of  steps  in  the  x  and  y  directions,  and  the  new 
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segment  of  the  test  image  was  projected  on  the  surface  of  the  array. 
The  same  procedure  described  above  was  repeated. 

EXPERIMENTAL  RESULTS 

A  selected  set  of  images  containing  man-made  cartographic  fea¬ 
tures  such  as,  road  intersections,  straight  line  roads,  and  rectangu¬ 
lar  objects  from  an  aerial  photo  transparency  and  a  few  mask  patterns 
were  used  as  input  test  patterns  for  the  system.  The  spatial  signal 
signatures,  the  associated  Walsh  transforms  (decomposed  spectral  sig¬ 
nal  signatures)  and  the  classification  results  are  shown  for  each  of 
the  test  images.  Figures  3  through  6  indicate  the  results  for  a  road 
intersection,  a  horizontal  line  road,  a  vertical  line  road,  and  a 
rectangular  object.  These  cartographic  features  were  placed  at  var¬ 
ious  positions  with  respect  to  the  window  of  inspection.  They  were 
detected  and  classified  correctly  regardless  of  their  location  with 
respect  to  the  window.  The  results  for  these  different  positions  are 
not  shown  because  of  the  limited  paper  size.  Figure  7  shows  the  de¬ 
tection  results  for  a  diagonally  oriented  road  intersection.  It  is 
found  that  the  correct  classification  was  obtained  for  a  majority  of 
feature  locations  with  respect  to  the  window.  However,  it  was  mis- 
classlfied  as  a  diagonally  oriented  line  road  only  when  the  center  of 
the  diagonally  oriented  road  Intersection  was  positioned  against  four 
corners  of  the  window  (not  shown).  This  is  because  the  energy  con¬ 
tributed  by  one  branch  of  the  diagonally  oriented  road  intersection 
is  much  stronger  than  that  of  the  other  branch.  Figures  8  and  9  are 
the  results  of  the  classification  for  the  diagonally  oriented  line 
roads  having  45- and  135-degree  angles  with  respect  to  the  x-axis  of 
the  window.  They  are  recognized  correctly  in  a  majority  of  locations. 
It  was  noted  that  these  roads  were  not  recognized  when  they  moved  to¬ 
wards  the  corners  of  the  window  (not  shown).  A  few  other  aerial 
photo-transparencies  containing  relatively  complicated  scenes  were 
also  tried.  Most  of  them  were  recognized  correctly,  while  some  were 
mlsclasslf led,  or  were  not  recognized.  The  results  are  not  shown,  in 
the  interest  of  brevity.  The  overall  results  indicate  that  the  Walsh 
transform  processing  technique  is  quite  successful  for  detecting  well- 
defined  linear  man-made  cartographic  features.  Nearly  90  percent 
recognition  accuracy  was  obtained  for  a  set  of  selected  cartographic 
features  of  the  classes  described.  A  rotational  dimension  may  be 
incorporated  in  the  future  to  refine  the  method  for  detecting  the 
above  cartographic  features  at  various  angles  with  respect  to  the 
axes  of  the  window. 

This  system  or  feature  extractor  will  be  integrated  in  parallel 
with  other  feature  extractors  which  are  to  be  developed  in  the  future 
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Figure  3.  Spatial  Signal  Signature,  Walsh  Transform,  and 
Classification  Result  for  Road  Intersection* 


*  CHEN  and  SEEMULLER 


8 


•  •  •  • 

•  •II 

•  I  I  • 

•  I  •  I 

•  I  •  • 

•  I  •  • 

•  •  •  • 

•  I  •  I 


•  I  •  • 

•  •  •  • 
•  •  •  • 
•  •  •  • 

«  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 

•  •  I  • 

•  I  •  • 

•  III 


•  •  • 

•  I  • 

:  :  : 

:  :  : 

•  «  • 
•  •  • 
•  •  • 
•  «  • 

•  •  • 
•  •  • 
•  •  • 


•  •  •  • 
•  •  •  • 

•  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 


•  •  • 
•  •  • 
•  •  • 
•  •  • 

•  •  • 
•  •  • 
•  •  • 
•  •  • 
•  •  • 
•  •  • 
•  •  • 
•  •  • 
•  •  • 


•  •  • 

:  s 

•  •  • 
•  •  • 
•  •  • 
•  •  « 

•  •  • 

•  •  • 


i  • 
•  • 
•  • 
•  • 


•  • 
•  • 
•  • 


M  IN  IN  Ml  IN  NHN  tN  HH 


N*  M« 

•  •  t 

•  •  • 
•  •  • 

,  •  •  • 

•  •  • 
•  •  « 

•  •  • 
•  •  • 
•  •  * 

•  I  • 

•  •  • 


:  :  : 
•  •• 

:  :  s 

::  : 

•  •  •  * 
•  •  • 
•  •  • 

•  •  • 
•  •  • 

•  •  t 

•  •  • 


•  •  • 

•  •  • 

•  •  • 

•  •  • 

•  •  • 


•  •  i 

•  •  « 

•  «  • 

•  • 


•  •  • 
«  •  « 
•  •  • 
•  •  • 
•  •  • 
•  •  • 
•  •  • 

•  •  • 
•  •  • 
•  •• 
•  •  • 
•  •I 


•  •  •  • 
•  «  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 
•  •  •  • 
•  «  •  • 
•  •  •  • 
•  •  •  • 

•  I  I  • 
WWW  I 


•  • 

§  i 

•  • 
•  • 
•  • 
•  • 

!  • 
•  • 
•  • 


•  •  • 
*  • 


•  •  • 
•  •• 

•  •  • 

:  : ; 
•  •  • 
,5  •  • 


IN  MW  • 

•  •  I  I 

•  •  *  *'* 

•  •  I  • 

•  •  •  I 

•  t  •  •  * 


•  •  *• 

•  I  «  • 

{•  #  • 

•  •  •  • 
•  •  •  • 
•  •  #-• 


Mt  St  1979  9 itS 


1 

K  S 

4 

9 

4 

7 

t 

4 

1 

1 

4 

4 

« 

4 

1 

4 

4 

4 

s 

•9  - 

m  | 

m  J 

4 

4 

4 

4 

m  fl 

4 

4 

S 

« 

4 

1 

4 

4 

4 

4  J 

1 

4 

4 

4 

7 

« 4  • 

4 

•  t 

4 

4 

• 

4 

•  | 

4 

4 

4 

9 

7 

4 

4 

4 

4 

14 

•1 

4 

4 

4 

4 

II 

4 

4 

4 

It 

1 

4  ^ 

*  ™ 

IS 

9 

4 

4 

4 

14 

«  %  fl 

4 

4 

•| 

4 

19 

*8 

4 

4 

4 

4 

14 

i 

4 

4 

1 

4 

I  9  19  II  It  IS  14  19  U 


9  4  9  4  4  # 

4  4  4  4  4  4 

4  9  4  4  4  4 

4  4  9  4  4  4 

9  4  4  4  4  4 

9  4  4  4  4  4 

4  4  4  4  4  4 

4  4  4  4  4  4 

4  4  9  4  4  4 


t 


Figure  4.  Spatial  Signal  Signature,  Walsh  Transform,  and 
Classification  Result  for  Horizontal  Line  Road* 
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VERTICAL  LINE  RORft 

Figure  5.  Spatial  Signal  Signature,  Walsh  Transform,  and 
Classification  Result  for  Vertical  Line  Road. 
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Figure  6.  Spatial  Signal  Signature,  Walsh  Transform,  and 
Classification  Result  for  Rectangular  Object. 
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Figure  7,  Spatial  Signal  Signature,  Walsh  Transform,  and 
Classification  Result  for  Diagonally  Oriented  Road  Intersection, 
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Figure  8.  Spatial  Signal  Signature,  Walsh  Transform,  and 
Classification  Result  for  Diagonally  Oriented  Line  Road 

(45  Degrees). 
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Figure  9.  Spatial  Signal  Signature,  Walsh  Transform,  and 
Classification  Result  for  Diagonally  Oriented  Line  Road 

(135  Degrees). 
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to  become  a  total  automated  feature  extraction  system. 

AN  ALTERNATE  DETECTION  SCHEME 

In  this  section,  an  alternate  scheme  for  detecting  the  decom¬ 
posed  spectral  components  (or  Walsh  transform  coefficients)  using 
analog  processors  is  described.  In  the  scheme,  two  cascaded,  32- 
stage  programmable,  binary-analog  correlators  [4]  are  used  as  shown 
in  Figure  10.  In  the  previous  section  it  was  shown  that  the  signifi¬ 
cant  spectral  components  in  most  cases  appear  in  the  first  8  by  8 
lower  order  Walsh  transform  coefficients.  Thus,  two  cascaded,  32- 
stage,  binary-analog  correlators  should  be  sufficient  to  process  the 
important  coefficients  to  yield  recognizable  results.  The  Walsh 
transform  coefficients  are  connected  to  the  input  of  the  analog  delay 
line,  and  the  binary  patterns  that  represent  reference  signal  signa¬ 
tures  will  be  connected  to  the  input  of  the  static  shift  register. 

Each  stage  of  the  analog  delay  line  has  a  pair  of  taps.  These  taps 
have  switches  in  series  with  them  that  are  controlled  by  the  true  and 
complement  outputs  of  the  static  digital  shift  register.  By  loading 
a  binary  word  to  it,  the  static  shift  register  will  select  the  taps, 
which  are  connected  to  two  output  lines,  thus  proving  the  ability  to 
do  correlation.  By  sweeping  the  known  binary  words  at  a  megahertz 
rate,  the  Walsh  coefficients  representing  a  particular  type  of  fea¬ 
ture  will  be  quickly  detected  in  the  output  of  the  operational 
amplifier. 

The  system  described  in  the  previous  sections  can  be  replaced 
by  using  this  suggested  scheme  together  with  a  solid  state  array,  a 
hardware  Walsh  function  generator,  and  some  minor  interface  and  dis¬ 
play  electronics.  Although  the  analog  method  is  relatively  compact, 
it  is  much  less  flexible  than  the  digital  method  described  earlier. 

CONCLUSIONS 

!•  The  signal  signature  of  the  spectrally  decomposed  cartographic 
features  is  much  simpler  in  distribution  than  the  spatial  signal 
signature  of  the  same  cartographic  feature  for  all  selected  cases. 

2.  In  most  cases,  the  significant  spectral  components  are  distributed 
among  few  lower  order  Walsh  transform  coefficients.  Further,  each 
transform  pattern  is  unique  in  itself,  and  it  can  be  easily  distin¬ 
guished  from  the  rest. 

3.  One  or  more  reference  signal  signatures  were  required  for  each 
class  of  the  selected  set  of  cartographic  features  since  they  may 
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Figure  10.  Alternate  Detection  Scheme. 
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appear  in  a  variety  of  locations  with  respect  to  the  window  of  in¬ 
spection. 

4.  Four  classes  out  of  the  entire  seven  cartographic  feature 
classes  selected  were  detected  and  recognized  without  error  regardless 
of  their  locations  with  respect  to  the  window.  The  rest  of  the  fea¬ 
ture  classes  were  also  classified  correctly  in  a  majority  of  loca¬ 
tions.  However,  misclassif ications  occurred  when  these  features  were 
positioned  very  close  to  the  corners  of  the  window.  Nearly  90  percent 
recognition  accuracy  was  obtained  for  the  selected  set  of  the  carto¬ 
graphic  features. 

5.  The  feature  extraction  scheme  presented  can  also  be  implemented  by 
using  a  group  of  analog  signal  processors  together  with  the  appropri¬ 
ate  interfaces. 

6.  Image  rotation  may  be  incorporated  in  the  future  to  refine  the 
scheme  for  detecting  these  cartographic  features  at  a  variety  of 
angles  with  respect  to  the  axes  of  the  window. 
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